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A CONTEMPORARY APPROACH TO THE PROBLEM OF DETERMINING 
PHYSICAL PARAMETERS ACCORDING TO THE RESULTS OF MEASUREMENTS 

P. Ye. El'yasberg 

Compared in the study are different approaches to prob- /Z* 
lems of determining (evaluating) some physical (biological, 
economic, etc.) parameters according to the results of 
measurements. Shown in the simplest examples are the short- 
comings of the classical approach, which gives rise- .tomthe.omethod 
of maximum probabilityeand its various modifications (method 
of least squares, optimal filtration, etc.), with which the 
distribution of probabilities of errors of the initial data 
is assumed as given. Also examined is the approach to the 
problems of evaluation, used in recent years, when the dis- 
tribution of errors Is considered unknown, and only some 
set, to iwhichlth.'rs5d3istribution belongs, is given. 

The basic results, obtained with this assumption, are 
described. It is shown using examples that these results 
are devoid, to a considerable extent, of the shortcomings 
inherent in the classical approach, and this approach is 
closer, in its nature, to the practice of solving problems 
of evaluation. 

1. Posing of the Problem /3 

With the processing of great masses of information 
(during processing of data of space and land physical experi- 
ments, in geodesy, during the solution of a number of bio- 
logical problems, in economics, during the determination of 
the initial data for controlling the movement of various 
systems, etc.), it is often necessary to solve problems of 

^Numbers in the margin indicate pagination in the foreign text. 
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determining some physical (biological, economic, etc.) 
parameters according to the results of measurements. 

We will use q = {q.i > • ■ ■ ,q m } to designate the vector of 

- the parameters which are to be determined, and d=£di , . . . ,d m } 

/ 

to designate the vector of the measured magnitudes. There 
occurs the relationship n % m between the number m of the 
parameters being determined and the number n of the magni- 
tudes being measured. With n=m, it can be said that the 
problem is solved according to a sufficient number of measure 5 
ments , and with n>m, according to a surplus number of measure- 
ments . We will absume that there is some mathematical model 
of the phenomenonain question, which makes it possible to conQ 
struct a dependence oftthe type d=d(q) . Then, the following 
, dependence exists between the measured value of d of the vec- 
tor d and the vector q: 


(o | & 

where i » • • • »i^n} is the vector of the total errors of 
measurement in the model d=d(q) . 

With these designations, the problem amounts to deter- 
mining the so-called evaluation q of the vector q, according 
to measurements of d using some algorithm of evaluation q=q(d) . 

The purpose of this algorithm is the potential elimination of 
the effect of the errors £ . With a surplus number of measure- 

, 3 , 

ments (n>m) , the problem of constructing an algorithm of evalu- 
ation, generally speaking, is'not similar. Therefore, the 
problem occurs of selecting an optimal algorithm. Different 
criteria of optimalness may be examined (rapidity of calcu- 
lation, simplicity of algorithm, etc.). We will subsequently 
proceed from the conditions of achieving maximum accuracy and 
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stability of evaluation of q. 

.Along with the problem of finding the magnitude of 
q=qCd0 3 it is of great significance to evaluate the accuracy 
of the obtained result. This is important, for example, 
during the comparison of results obtained on the basis of 
different mathematical models, and according to different 
measurements, as well as in those cases when the found 

S .A, 

magnitude of q is utilized for purposes of controlling the 
movement of some system (for example, for control of the 
flight of a spacecraft) . 

We will subsequently call all of the problems examined 
here problems of evaluation . 

2. Classical Approach to Problems of Evaluation 

The construction of the optimal algorithm q=q(d) and the 
evaluation of the accuracy of the obtained magnitude of q de- 
pend substantially on the adopted assumptions on the error £ , 
which is part of the right side of dependence (1) . Weewill 
call the set of these assumptions the model of errors in the 
future . 

/ 

With the classical posing of the problem, C is viewed 
as a random vector with a density of probabilities F(£,p) , 
given with an accuracy of up to some vector p=Cpi , • • • ,p K } of 
the parameters of distribution. In this case, the evaluations 
of q) and p are found using the so-called method of maximum 
probability , which consists of the search for the minimum of 
the function of probability (q) =F[d-d(q) . In other words, 

In this case 


" , ar 2 F (<£}] , p} 
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Assuming that the distribution F( c) of the vector of £ 
is normal with a given mathematical expectancy and a co- 
variation matrix D(^) , which is known with an accuracy of 
up to some positive multiple d 2 , the method of maximum 
probability is reduced to the method of least squares . If 
E(e) is given, then one can always reduce the problem to a 
form in which E(s)=0 Cl]. Thus, the problem, according to 
the method of least squares, is solved with the assumption 
that 

f FCl)=Jf(0,6r l L), (5) 


where D(^)] is the known expression for the density 

of a multiple normal distribution with given mathematical 
expectancy E(^) and covariation matrix D(^) , and L is the /6 

given positively-determined matrix. 

By making use of dependences (2) and (3)» we obtain an 
algorithm of evaluation according to the method of least 
squares Ell. 


^ = arg mu* [ d - cl (cpl L [ 4 - d Up] . (4) 


We will note that, in the literature, the method of 
least squares is often understood as algorithm (4) in that 
case when the matrix L is diagonal. However, we will pro- 
ceed here from the more general determination (4) of this 
method . 

The methods of maximum probability and least squaresbhave 
a long history. The method of least squares was first devel- 
oped by Gauss in 179^. For nearly two centuries since this 
time, this method recommended itself well for the solution 
of various problems of celestial mechanics, geodesy, experi- 





mental physics, and other sciences. The widespread dissemi- 
nation of the indicated methods in the common form, as well 
as in various modifications (method of a maximum of empirical 
probability , Kalman's filter, method of optimum allocation’, ~etc ♦ )', 
evoked thee'mmtentesrnterest of a number of leading specialists 
in the area of TmaS'hemat' i j c aiO- statistics. Their labors under- 

* v 

lay the conducting of a serious mathematical investigation 
of these methods, in which it was shown that they possess a 
number of appreciable optimal properties These proper- 

ties have an asymptotic nature, i .e . , they are demonstrated 
with a number of measurements n=f°°. In this case 

-the mathematical expectancy of error 6q of the evalu- 
ation of q approaches zero (asymptotic empiricalness); 

-the dispersions of all of the components of the error 6q 
approach their minimum values in ahgra at thumb erf oflallf ofh&he 
possible empiricalnalgorithms of filtration (asymptotic /? 

effectiveness) ; 

-the distribution of the errors of the obtained evalu- 
ations approach efsoi norrn.aia<^s^ripD J t bt rep nbrmal cy ) ; 

-the evaluation of q, with some additional assumptions, 
coincides, in probability, with the true value of q (con- 
sistency) . 

We will note that the effectiveness of the method of 
maximum probability, strictly speaking, does not hold for all, 
but only for "nearly all" of the true values of the vector q. 

In a great number of these vectors, so-called supereffective 
evaluations may exist [3]* 

In addition, the indicated properties are usually proved 
with the assumption that the vector r, may be j presented in the 
form of a set of mutually independent and equally distributed 
vectors. If this condition is not fulfilled, then some of the 
Indicated properties may not occur. Specifically, in this 
case, the evaluation according to the method of least squares 
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may be inconsistent 


The following practical conclusions are usually drawn 
from the indicated properties of the examined evaluations: 

-any enlisting]?. fear the solution of the problem, odf 
additional measurements is useful, since it leads to improve- 
ment of the accuracy of solution of the problem; 

-by increasing the number of utilized measurements with- 
out restriction, one can obtain as high an accuracy of evalu- 

^ A 

ation of q as is desired". 

The indicated theoretical properties of the evaluations 
of the maximum probability evoked in the experimenters and 
processors of information a striving to eniis&castmanyomoreon 
mdasurementseastpessi'bibensfdrtjjhe solution of problems of the 
examined type. Discovered for this purpose in recent years 
were greater possibilities, determined by the rapid develops 
ment of measuring and calculating technology. Many thousands 
of measurements are utilized in a number of critical problems. 
However, in practice, it turns out that an unrestricted in- 
crease in the number n of measurements does not provide the 
desired effect. Beginning with some n, the accuracy q prac- 
tically ceases to increase, often beginning to worsen. In 
this ease, it turns out that 'the evaluations of the accuracy 
q, obtained on the basis of the theory of the methods of maxi- 
mum probability and least squares, are unjustifiably opti- 
mistic. The latter circumstance is especially intolerable 
during the solution of critical problems (determination of 
basic physical constants, comparison of results obtained on 
the basis of various mathematical models, determination of 
initial data for the control of movement of different systems, 
etc . ) . 

i 

The indicated circumstances are well-known by many re- 



searchers, who are practically occupied by questions jdf 
processing great masses of information. In them, a sense 
of distrust has long been rooted towards the evaluation of 
the accuracy obtained on the basis of the theory of the 
methods of maximum probability and least squares. This 
lack of correspondence between the theory and practice may 
be explained only by deviations of the real conditions of 
the experiment from the assumptions utilized during the con- 
struction of the methods of maximum probability and least 
squares (since the theory of these methods is mathematically 
strict) . 

As is evident from expressions (2) , (3) . and (4) , the 
algorithms of evaluation, according to the examined methods, 
depend substantially on the distribution F(?) of the errors 
Z. During the construction of these algorithms, it is neces- 
sanyythat this distribution be given in advance. With a devi- /9 

ation of the actual distribution F(c) from the adopted distri- 
bution, the optimal properties indicated above do not occur. 

We will elucidate this fact in examples . 

We will examine the problem of determining some scalar 
magnitude of q, according to its measured values of 
di(i=l , . . . ,n) . In this case, dependence (4) takes on the form 


| k (5) 


During construction of the algorithm of evaluation, we 
will propose that the errors £•£(£.= l,...,n) are distributed 
normally, with zero mathematical expectancy and a dispersion 
0 2 . In this case, the correlation between the different errors 
is absent. Then, expression (3) may be written in the form 

, (6) . 
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where I is a unit matrix. 


With these assumptions, algorithm (4) of evaluation, 
according to the method of least squares, is reduced to the 
search for the arithmetic mean 




0 ) 


We will designate the error in the obtained evaluation 
by Sq=q-q, and adopt the following magnitude in the capacity 
of the '"characteristic of accuracy 

! JHE(8*<P , 

where E(S s q) is the mathematical expectancy of the square of 
the error Sq. 

We will utilize P. to designate the value of p with the 
utilization of algorithm (7) and assumption (6) . It is easy /10 
to show that 

Jr • ®) ' 


Prom expression (8) , it follows directly that 


tun 0 , 


C9) 


i ■ e . t evaluation (7) > with assumption (6), is consistent. In 

this case, an increase in the number n of utilized measurements 

* /\ 

always leads to an increase in the accuracy of evaluation of q . 

We will now assume that assumption ( 6) is actually not 
satisfied, but we will continue to utilize algorithm (7) « Let 
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the errors ££, in actuality, be represented in the form 


( 10 ) 


where rj are the errors of the model d=q, and £" are the errors 
in the measurements. 

The errors occur because of the fact that the measured 
magnitude of d is not constant in actuality, but changes 
according to some law. Suppose that the only thing that we 
know about this law is the fact that the rate d of change in 
d is restricted according to a modulus, i.e. , |d[^ v, where v 
is a given constant. We will adopt the value of d at the 
initial moment in time t=0 as the parameter of q being evalu- 
ated. We will assume that the measurements of d are carried 
out at the moments ti=±^r,( j=0 ,1 , . . . , — , where t is the 

given spacing of the change in the time of the measurements 
(here, we will limit ourselves to the case of uneveness of the 
number n of the measurements) . With these assumptions 

(ii) 


As far as the errors £ £ in measurement are concerned, we 
will assume that their mathematical expectanc jesaare equal to 
zero, the dispersions Z?(c£) do not exceed the given magnitude 
of m ^ x , and the coefficients of correlation K( C£,£g) 
do not exceedvtheegivenKvalile of)K ( ^j'E ']■ 1 ihsh ifhe e ut il i z ing 

dependences (10) and (11), we find that the mathematical 
expectancies E(?^.), the dispersions D(^^) , and the coefficients 
of correlation K(£ ^ , C e ) of the errors z, 1 satisfy the in- 
equalities 



Comparison of models (6) and (12) of the errors shows 
that the former assumes a sufficiently complete knowledge 
of the distribution of the errors e; , while the latter imposes 
only slight restrictions ofi the characteristics of this dis- 
tribution. Such an approach is considerably closer to the 
real conditions, under which applied problems of information 
processing are solved. In this case, is does not seem 
possible to determine the accurate value of the magnitude of 
p. However, itsis possible to find its so-called guaranteed 
value 


^guar~ max P * 


(«) 


where max appears in the set. ■'•SLTpfnhll of the distM-bi?\ 
buttons which satisfy the conditions in (12). 

Making use of dependences (5) and (12) , one can show 
that during the determination of the evaluation of q, using 
algorithm (7) 



i-K , . r 1 

mr + K+ T 




(14) 


/l 2 


where y~ • 

° max 

It is evident from expression (1^) that, as a function 
of the values of the magnitudes of K and y> f* either in- 
creases monotonously with an increase intibhe number n of 
measurements, or diminishes at first, reaches some minimum, 
and then begins to increase, With 7=0, the minimum is not 
reached for a finite n. In all cases 

- J^ with im 

l,f “”guar l 00 with ~f?0 , 
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D.epicted by "the solid line in figure 1 is the graph of 
the dependence of the ratio p g<ia7 /d infly on n with K=0.01, y = 0-01- 
The dotted line in this same figure depicts the graph of the 
dependence p./d on n, calculated according to formula (8) . 


It is evident from the given results that, with the 
assumptions in (12), evaluation (7) proves inconsistent 
(one can show that, with these assumptions, it is generally 
impossible to construct a consistent evaluation). With Y'/O, 

there exists some optimal number n ^ of utilized measure- 

. opt 

ments . With n ^n & p t , any increase in the number n leads to 
impairment of the accuracy of the evaluation of q. 

Thus, the switch from model (6) of the errors to model 
(12) fundamentally changes the nature of the dependence of 
the evaluation of the accuracy of the magnitude of 'q on the 
number n of utilized measurements. In this case, model (12) 
ensures obtaining of results which are considerably closer 
to practice in the processing of measurement information. 


From (8) and (15) » it follows that if at least one of 
the magnitudes of K or y^O , then 


a 

Urn , 


( 16 ) 


Thus, with as small a deviation from the ideal model (6) 
as desired, and a sufficiently great n, expression (8) does 
not at all. characterize the actual accuracy of the evaluation 
(?) • This phenomenon we will subsequently call the instability 
of the magnitude of fL , according to the basic assumptions. In 
practice, some deviations from model (6) are unavoidable. 
Therefore, expression (8) may be utilized only with small n. 
With sufficiently large n, it is necessary to switch to a model 
of errors which takes into account the potential spread of 
the characteristics of distribution of the vector z, in prob- 



lems of evaluation of the accuracy of the magnitude of q and 
the selection of the optimal composition of the measurements. 
In this case, evaluation (7) proves to he biased and incon- 
sistent • 

In the capacity of a second example, we will examine the 
problem of determining the velocity v of the change in some 
magnitude d at the initial moment In time t=0 . Here , we 
will make use of the linear model 

Si*^-3-ut v + ^ U~v. M n), (1?) 


where d^ is the measured value of d, a is some constant, t£ 
is the time of the measurements, and is the error. ' 

if 

We will assume that the moments t-f are determinednby by 
the expressions 

..,%)» 08 ) 


where T is the given time . 

By solving the problem by the method of least squares, 
with assumption (6), we find the desired evaluation: 

0- =Z . 09) 

L:< 


The dispersion of this evaluation with assumption (6) is 




(& 0 ) 


We will note that 




Thus, although the magnitude of Z> 0 (v) diminishes with 
an increase in the number n of measurements, it has a lower 
boundary which is not equal to zero- Therefore, evaluation 
(19) i with assumption (6), proves inconsistent. This is 
associated with the selection of the time of the measure- 
ments (18) . 

We will now assume that the errors t . are correlated 
among themselves. Here, the coefficients of the correlation 
are 



jtwtt , 0 

* t* t { < Q ? 



where kj. and k 2 are given magnitudes, which satisfy the con- 
ditions 


K<>K ty K' + K.^O, \KUi ? \Kz\H 


One can show that the correlation matrix made up of these 
coefficients is positively definite, i .e . , the conditions in 
(23) are correct. 
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With proposal (23) , and the assumption that D {^ .) = 
d 2 ((^=1 , . . . ,n) , the dispersion of evalution (19) is deter- 
mined hy the expression 



Then, making use of the inequality 

Z T > th ( f -H ) , &$) 


we find that 




From here, it follows directly that 


f>m £t>, C"d ) - go . 

»» i 


(?-S) 


Depicted in figure 2 hy the solid line is the graph of 
the dependence of d i(C)-^pr on ihe number n, assuming that 

ki = k 3 =0.1. In the same figure, the dotted line depicts the 

graph of the magnitude of D (v ) — — , calculated according to 

o 

formula (20) . 

Thus, in this example as well, the enlistment of additional 
measurements leads to an unrestricted increase in the error 
of the measurements. Here, 
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i .e . , expression ( 20 ) proves unstable with any ki-kg&O.uno 
matter how small . 


Apparent in the given examples is a sharp increase in 
the effect of small correlation dependences between the com- 
ponents of the vector £ with an increase in the number n of 
these components. This may be illustrated on an example of 
the calculation of the dispersion of the sum of the compon- 
ents of the vector £ : 


a>(£y = ZKCM,)\|acw#(s,) 


The total number of diagonal terms in the right-hand 
portion of this dependence is equal to n, and the number of 
nondiagonal terms, associated with the presence-' of corre- 
lation connections between the components of the vector, is 
equal to -n(n-l) . Therefore, the coefficients K( g 5..) of 
the correlation on the order of 1/n may have a substantial 
effect on the examined expression. With K(£ . , C .) on the 
order of n (0<a<l) , their effect becomes decisive. 


The instability of the classical evaluations , of h accuracy, 
shownxinpthe j examples , has a general nature. One can prove 
that, if the distribution F(S) of the errors ? is selected -so 
that the corresponding evaluation of the least squares (maxi- 
mum probability) is theoretically consistent, then, with 
sufficiently general assumptions, the classical evaluation 
of accuracy of the obtained results proves to be unstable in 
the sense indicated above. Thus, the theoretical consistency 
of the evaluations of the maximum probability and the least 
squares not only is not accomplished in practice, but also 
leads to inconsistency of the evaluations of accuracy with 
possible deviations from the adopted distribution F(c) . 


As is common knowledge, it often turns out in practice 



that some percent of the measurements is "burdened with large 
errors, which occur from the adopted distribution F(g) . 

These measurements are usually called anomalous. The method 
of least squares i based on the assumption of the normalcy of 
the distribution F(c), is especially sensitive to similar 

t 

measurements . 

In the capacity of an example, we wi.l examine the 
solution of problem (5) using algorithm (7) of the method 
of least squares. We will assume that, among n measurements 
of d^( ( 'i=t , . . . ,n) , there is some number m of anomalous 
measurements , which have the same error c^=A{ (•£ =1 , . . . ,m) • 

The errors of the remaining n-m measurements are distributed 
according to the law in (6) . Then, the evaluation q, deter- 
mined according to formula (7) > will have the additional error 

5 add<V“P A > P=£' W 

associated with the presence of anomalous measurements. 

It is evident from comparison of expressions (8) and (29) 
that, if there exists such ane >0 that the inequality p>£ 
takes place, irrespective of the number n, then, with a 
sufficiently great n, the additional error (29) becomes de- 
cisive . 


We will compare the obtained result with the solution of 
the problem according to the method of a minimum of moduli, 
with which the evaluation of q is sought from the expression 






eso) 


As is common knowledge, here, the algorithm of evaluation 
is reduced to the search for the selective median of the set 
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of numbers d (,£= 1 , . . . ,n) , i.e. , the magnitudes of q for 

Is ' 

which the number of measurements of cl i 3 which satisfy the 
inequality d i £q, is equal to the number of measurements* 
which satisfy the inequality d;5 q [53* The additional 
error 6 ac ^q of this algorithm, associated with the anomalous 
measurements indicated above, may be found from the equation 


V4A 

i a 


0 


1 r\ 

"tt-m 

* 




where , is the normed density of the normal 

distribution. 

The approximated solution of this equation, with a 
sufficiently small p, gives 

- pSb/23T . (^) 

It is evident from comparison of expressions (29) and 
( 31 ) that the additional error of the method of least squares 
is proportional to the magnitude A of the anomalous error, 
whereas the additional error of the method of the minimum of 
moduli does not .depend on this magnitude. Therefore, with 
A»b, the second of these methods proves considerably less 
sensitive to anomalous errors of the examined type. 

The strong dependence, shown in the simplest example, of 
the evaluations of the method of least squares on anomalous 
errors in measurements has a sufficiently general nature. It 
is associated with the principle of minimization of the quad- 
ratic form from the vector’ of discrepancies. ' Therefore, in 
practice, during evaluation according to the method of least 
squares, as a rule, one makes use of different empirical and 
semiempirical method of preliminary purification of the 
measurement information from coarse anomalous measurements. 



3. Contemporary Approach to the Problems of Evaluation 

The aforementioned shortcomings in the classical 
methods of evaluation are determined "by the fact that the 
actual distributions P(^), which are part of dependence (1) 
of the errors, differ from those used during construction 
and analysis of algorithms of evaluation. One of the methods 
of overcoming this circumstance consists of numerous attempts 
to make the distribution F($) more precise, according to the 
results of measurements (so-called adaptive algorithms of 
evaluation) . Although a number of interesting results is 
obtained in this way, its possibilities are limited. Even 
if we limit ourselves to finding the mathematical expectancy 
E(^) and the covariation matrix D(?), with simultaneous 
searching for the evaluation of q={qi , ■ . . ,q }, then it will 
be necessary to determine a total of 1 • S' scalar magni- 

tudes , according* to anemeasurements of the components of the 
vector <f. Apparently, this is impossible, since the number of 
determinable magnitudes considerably exceeds the number of 
measurable magnitudes . Therefore , all of the existing adap- 
tive algorithms of evaluation are based on sufficiently 
strict assumptions on the form of the distribution P( ?) . The 
most widespread is its representation in form (3) , with a 
fixed matrix L. In this case, the adaptation amounts to the 
search for the most suitable value of the ‘factor d 3 . It is 
evident that, in this posing of thepproblem, all of the afore- 
mentioned shortcomings of the method of least squares remain 
in force . 

A principally new approach to the problem of evaluation /ZO 
consists of rejecting the representation of the distribution 
F(0 and replacing it with some set F , which includes the 
possible distributions of the vector £ . We will use N to 
designate some scalar characteristic of the accuracy of evalu- 

, A 

ation of q. For definiteness, we will consider that any in- 
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crease in the accuracy of q corresponds to any decrease in N, 
Then, in the capacity of a guaranteed characteristic ^guar°f 
the accuracy (6), we will adopt its upper boundary in the set 
F t i ■ e ■ , the magnitude which satisfies the inequality 

JVguar with ( 32 ) 

If N , guards an accurate upper limit, then we will speak 
of a strict guaranteed characteristic of accuracy. In this 
case 




(33) 


The search for a minimum of the strict guaranteed charac- 
teristic of accuracy serves as a criterion of optimalness in 
problems of selecting a strategy of evaluation ( i.e. , the 
choice of an algorithm of evaluation, a plan of measurements 
and a mathematical model of the system he in g= examined) . Here, 
the optimal strategy S opt is found using the dependence 

^p t = ara mini sup JT , 04) 

where the minimum is sought in the given set £ of permissible 
strategies S . 


We will note that the advisability of a similar approach 
to problems of evaluation was evidently clear even to classical /21 
scholars of mathematical statistics. However, the algorithms 
of evaluation based practically on this approach began to 
be created only in the middle of the 1960’s. This is explained 
by the following reasons . 


A. In recent years, requirements have sharply increased 
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for efficiency of evaluation and reliability of determination 
of the accuracy of obtained results. This is associated wi-th 
the fact that evaluations of the parameters of physical 
phenomena are being used ever more widely during the solution 
of important applied problems (such as the control of move- 
ment of different systems, the determination of basic physical 
constants, etc.) . 

B . The switch to automatic methods of processing of 
measurement information on computers made it especially in- 
tolerable to utilize different empirical and semiempirical 
methods of information processing, based on the intuition of 
the researcher and requiring repeated intervention by man 
into the operation of computers. 

C . The constant improvement of measurement and computer 
technology has stipulated the possibility of a sharp increase 
in the volume of measurement information utilized during 
evaluation. However, in this case, the effect of the indi- 
cated instability of the classical results is manifested 
especially strongly. 

D. The utilization of modern computers and the algorithms 
of optimization developed in calculations for these machines 
has revealed the practical possibility of solving sufficiently 
complex problems of the type of (3^0 ' 

It is evident from dependences ( 33 ) and ( 3 ^) that the 
solution of problems of evaluation, based on the approach 
indicated above, depends substantially on the type of set F 
of possible distributions of F(^) , as well as the utilized / 22 

characteristic of accuracy of f ’and the - 'mathematical- •model (1). 

V * 

In this connection, there is not a&'genera~lom&tftodofor i solving 
these problems at the present time. However, for individual 
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specific cases, sufficiently far-reaching results have been 
obtained, and effective numeric algorithms have been developed. 
A brief description of these results is given below. 


4. Anti-Interference Evaluation 

As was indicated above, one of the shortcomings of the 
method of least squares is the great effect of anomalous 
measurements on the accuracy of the obtained evaluations . 

The presence of this shortcoming, as well as the necessity 
of a new approach to problems of evaluation, were indicated 
in studiess[7 >83* First proposed in study [93 was the method 
of construction of anti- interference evaluation, and its 
asymptotic optimalness was shown in terms of (34) , for one 
class F of possible distributions of F(c), which are close 
( in a certain sense) to normal. This method was developed 
in a number of subsequent studies. In study [10 3, it was 
generalized to multiple regression problems. In this study, 
as well as in [11 3 > they analyzed the dependence of the type 
of anti-interference algorithm on the set F of possibleddis- 
tributions of F( ?) . One of the types of anti-interference 
algorithms, namely the method of the minimum of moduli 
(selective medians in a unidimensional case) , was studied 
in detail in studies [ 5 > 123 * 


All of the indicated studies are based on the assumption 
that the vector d of the measurements is a set k of vectors 
(in the specific case — scalars) dj* (j =1 , . . . ,k) , which are 
identically associated with q. The vectors of the errors Zj 
(j=l,...,k), which are assumed to be mutually independent 
and equally distributed, correspond to these vectors in 
dependence (1) . Here, the magnitudes which are part of 
equality (1) may be represented in the form 


1 





> ( 35 ) 


/2 2 
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where the function d'(q) determines the dependence of any of 
the vectors (scalars) d j ■ ,k) on q. 

In this case, the density F(?) of distribution of the 
vector x; may he represented in the form 

Fd)--n f’h) , 1 

>M 

where F ’ ('^ ) is the density of distribution of any of the 
vectors £ j ( =1 , . . . ,k) . 

In addition, it is assumed that the mathematical expec- 
tancy is 


E (js,) = o 

J 


( * 0 , 


( 3 ?) . 


Here, the condition F( ?)eF is replaced by the condition 

F (j , *0, 0$) 

where F 1 is the set of possible densities of distributions 
of the vectors r. ( =1 , . . . ,k) . 

The dispersion of the evaluation of any scalar function 
of the vector q is utilized as the characteristic N of the 
accuracy, in dependences ( 32 ) -(, 3 ^) • 

The essence of the examined methods of constructing anti- 
interference evaluations consists of -thatfact .thaifctwi thing /zk 

the set F' is selected the worst distribution of F’(£j) zF ' , 
in which the minimum of Fisher information is achieved. 

Constructed for this distribution is the corresponding algo- 
rithm of maximum probability, and it is shown that, asymptot- 
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ically (with k-*») , it satisfies the condition of optimalness 
of the type of ( 3 ^) [ 10 , 11 ]. 

Specifically, if the set of all distributions, for which 
the density F'(0)$ s>0, is viewed as f ' , then Laplace's 
distribution is the corresponding worst distribution, and 
the method of the minimum of moduli is the optimal algo- 
rithm of filtration. In other words, this method corresponds 
to the case when practically nothing is known about the dis- 
tribution F'(£j) . 

Thus, the anti -interference properties of the method of 
the minimum of moduli, shown above in the simplest example, 
has a sufficiently deep theoretical basis. Also examined in 
studies [ 10 , 11 ] are other methods of representing the set 
F 1 , for which the corresponding optimal algorithms of evalu- 
ation are constructed. 

On the whole, the examined method of constructing anti- 
interference evaluations is promising, since it reveals the 
possibility of automation of the process of exclusion of 
anomalous measurements, and, finally, makes it possible to 
reduce to a minimum the intervention of man in the solution 
of problems of evaluation on computers. 

A shortcoming of this method is the fact that it is 
based on assumptions (35) » (3^) , and (3?) ■ Here, the effect 
of correlation dependences between the vectors 5 j (j*=l,...,k) 
is not taken into account at all, and neither is the possible 
spread of the mathematical expectancies of these vectors. As 
was indicated above, with a large number of utilized measure- 

# A 

ments, this effect on the evaluation of the accuracy q becomes 
decisive. Demonstrated here is the inconsistency of evalu- 
ations of accuracy according to the adopted assumptions. The 



latter fact is associated with the fact that the obtainable 
evaluations of q, in the majority of cases, are theoretically 
consistent . 

$. Evaluation with Restrictions According; to an "Upturn'' 

(Case of Random Correlation of Errors) 

The aforementioned strong effect of the correlation 
dependences between the components of the vector x, on the 
accuracy of the evaluation of q, as well as the impossibility 
of the reliable determination of these dependences, were causes 
of the appearance of a considerable number of studies, in 
which the existence of a random worst correlation between 
the magnitudes of 5 ^ (i=l,...,n) is assumed. In other words, 
it is assumed that the coefficients of correlation K(r . , r • ) 

is U 

may take on any values in the closed interval Here, 

different methods are utilized for representing the set F . 

The simplest of these are the so-called restrictions according 
to an "upturn" , of the form 

U-«l ^ Si (U*,.. I*). (?*> 


where 6 i ( i= l,...,n) are the given non-negative numbers. 

Here, the guaranteed characteristics of accuracy ( 33 ) 
are determined by the expression 

n i\OJ- 


X. ■ - max 
guar s 





where 5 ^ is the error in evaluation of £ of some scalar magni- 
tude l -Jt(q.) • 

In the more general case , the following restrictions /26 

may be utilized in place of (39 ) ' 


24 



L eQ > 

where Q is the given set in the space of the vectors £ . 

p 

Often, in place of the conditions in (39) , restrictions 
are set on the values of the dispersions of the magnitudes of 

? i 


(IM ft), 

- v 

Here, the possibility is assumed of the random correlation 
between different components of the vector £, and the follow- 
ing magnitude is utilized as the guaranteed character sit ics 
of accuracy 


£>cse). C42) 

One can show that, for a sufficiently broad class of 
algorithms of filtration, the search for an optimal strategy 
of evaluation, based on the minimization of expression (4-0) 
with thee conditions in (39) » is equivalent to the solution 
of the very same problem by means- of minimization of expression 
(4-2) with the conditions in (4-1) [1]. 

Such an approach to problems of evaluation was first 
utilized in study [133* Examined here was the problem of the 
selection of an optimal body of measurements, which provides 
the achievement of a minimum of expression (4©) with the con- 
ditions in (39) and filtration according to the method of least 
squares. The problem was reduced to linear programming, for 
which there are well-developed algorithms of numerical solution. 
The basic properties of this solution were studied. This study 
served as an impetus for the conduct of a considerable number 
of studies in the indicated area. Exhaustively studied here 
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was the problem of the selection of an optimal linear unbiased 
algorithm of evaluation, and an optimal plan of measurements /27 
with conditions (39) and (4o) or (4-1) and (4- 2 ) . 

Developed here, along with a method for solving the 
problem of optimization, was a method which amounts to, the 
finding of some generalized Tchebycheff polynomial which i s 
deviates the least from zero.[l4], as well as a method which 
utilizes the graphic geometric interpretation proposed in [ 15 ]. 

A listing of these studies and their results are located in 

[ 1 , 16 ]. 

The basic result of the indicated studies is proof of 
the fact that, with the assumptions made, only m of the 
appropriately selected measurements are optimally utilized 
(here, m is the dimensionality of the vector q) . A further 
increase in the number of utilized measurements is not only 
of no use, but, generally speaking, leads to impairment of 
the guaranteed accuracy of the obtained evaluations. It is 
evident that, under these conditions, it is also impossible 

A 

to speak of the consistency of the evaluation of q. Thus, 

Results were obtained which are fundamentally contradictory 
to the conclusions drawn on the basis of the classical assump- 
tion ( 3 ) * 

In those cases when the mathematical model (1) is con- 
structed on the basis of the solution of the vector differ- 
ential equation of movement 


where t is the time and J1 is the interference vector, and con- 
ditions of the type of (39) ord(4l) may be imposed not Toni y^on-- 
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thefvecforsc of errors , but alsonon the vector n • 


With similar assumptions, one concrete problem of evalu- 
ation of the accuracy of determination of movement was examined 
i n [ 17 II* In studies Cl 8, 19]. this posing of the problem was 
utilized for the study of determination of the movement of a 
spacecraft, using Kalman-' s filter. A detailed analysis of 
the problem of construction of an optimal recurrent algo- 
rithm of filtration, with ausjiff iemently general method of 
representation of the sets to which the vectors of errors of 
measurement and interference vectors mayi-belongy + is" carried 
out in' t 203 * , 

As an example, we will examine the problem of determining 
the velocity v of the change in some magnitude d at the initial 
moment of time t=0 . Here, we will make use of the linear model 
(10), and assume that the errors satisfy the condition 

CUV- ,n), (44> 

where a>0 and ? w>a. are given numbers- The former of these 
characterizes the maximum possible error of the measurements, 
and the latter characterizes the maximum acceleration of the 
magnitude d, not taken into account by the linear model (17)* 
This acceleration, generally speaking, is variable, and we 
are only given the maximum of its modulus. 

We will find the evaluation of v of the desired magni- 
tude, using a linear algorithm of filtration; 

0- - Xv di , - (45) 

1*1 

where xi ( £=!,..*, n) are, for now, the random coefficients of 
the algorithm, which satisfy the condition of empiricalness 
Cl], which, in the examined case, may be written in the form 



f. Xi =0 , £. jtiXv - t 

111 t, i * 


( 46 ) 


Here, the error 8 V of the evaluation of v is determined 
"by the expression 




I 


( 47 ) 




Hence, making use of (44) , we will find the guaranteed 
characteristics (40) of accuracy 




In this posing of the problem, the selection of an optimal 
strategy S of evaluation in the set £ of possible strategies 
is reduced to the search for the number n of measurements, 
as well as the times t i and the coefficients , which satisfy 
condition (46) and provide the achievement of a minimum of 
the magnitude in (48) . 


Switching to the solution, we will note that the 
dimensionality of the vector q={a,v} of state of model (17) 
m=2. Hence, making use of the results given above, we find 
that the minimum of expression (48) is achieved with a number 
n=m=2 . Then, making use of (46), we will find the dependences 
between the times t i of the measurements and the corresponding 
- coefficients ^ (£=1,2)» 


X.*-X 2 


Vti 


Substituting these expressions into (48) , and seeking 
the minimum according to t x and t 2 , we obtain the solution of 
the problem. 

> X,=-X 1 4x^ . M9> 
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Here, the following is achieved 


min jJY* >= ' win max jS'C j . <5Q) ' 

1 ^ I gkar ^ \ 

We will note that, daring the determination of the set £ 
of possible strategies S, we do not impo.se any restrictions 
on the times t 


7 We will compare the obtained result with the evaluation 
according to the method of least squares, with the assumption 
of equal accuracy and non-correlation of the errors Jig • In 
this case, we will assume: that the measurements are carried 

out with a constant spacing t, according to the time aib the 
moments 

.. y K) , <5I) 

where k=n/2 (n is the total number of measurements). 


With these assumptions, the coefficients (^=l,...,n) 
of algorithm (5?5) are determined by an equality of the type 


. Y ._ tv" j 


(52) 


where, In the expression £t 3 , the summation is carried out 
according to all times t^. . 


Substituting (52) into (48), and making use of (50), as 
well as the known expressions for the sums of the orders of 
a natural series of numbers, we find 

y _ _ 5 [2ft + K (K-«d)1 (53) 

j "fttiar ip 4(2^1) ft 

where "the value of the guaranteed characteristics (48) 



of>3accuracy with evaluation according to the method of least 
squares and a uniform distribution of the times of the 
measurements , and 



We will record the number k and search for the magnitude 

of 3 which ensures achievement of miny. It is easy to show 

\ 

that this will he the case with 

(55) /2l 


Substituting this value of 3 Unto (53) j we find 

7 »•> 

It is easy to assert that, with an increase in k, m £*y(K) 

increases monotonously from a magnitude to min, 

27^^1,06' • The lower boundary of this interval corresponds 
to the total coincidence of the examined algorithm of evalu- 
ation, according to the method of least squares, with the 
optimal linear unbiased algorithm given above. We will note 
that, with a sufficiently large k, equality (55) may be re- 
placed with the approximate dependence 

T x. \pZ T 0 , (57) 

where T=2xk and T =t 2 -tn r are the time intervals within which 

o 

the measurements are carried out, with evaluation according 
to the method of least squares and with utilization of the 
optimal algorithm (49) , respectively. 

Based on the obtained results, one can draw the following 
conclusions . 
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A. With planning of the experiment in accordance with 
dependence (55) or (57) , evaluation according to the method 
of least squares, with uniform distribution of the times t'£ 
with any number of measurements, is practically equivalent to 
the optimal algorithm (49) • This circumstance may be utilised 
in that case when, along with the errors £i> which satisfy 
the ceondirt i ores in (44), mutually non-correlate d errors?^ are 
part of the r'ighthand portions of the dependences in (17) • 
Then, making use of the method of least squares, with a 
sufficiently large number n of utilized measurements, 

one can practically preclude the effect of the errors 

B. With a deviation from the optimal relationships (55) 
or (57) in one direction or the other, the guaranteed accu- 
racy of evaluation, according to the method of least squares, 
is impaired unrestrictedly. 

C . The best guaranteed accuracy of the magnitude is 
determined by expression (50) , which does not depend on the 
plan of the experiment. Thus, with the examined posing of 

A 

the problem, consistent evaluations of v do not exist. 

The conclusions obtained here on the simplest example 
have a sufficiently general nature . Experience in the use of 
evaluation ’’according to an upturn" applied to different, 
sufficiently complex problems shows that the method of least 
squares is practically equivalent to the optimal linear un- 
biased algorithm of evaluation in that case when the planning 
of the experiment is accomplished on the basis of the methods 
set forth above. With non-observance of this conditions, the 
guaranteed accuracy of evaluation, according to the method of 
least squares, may be considerably worse than the optimal 
accuracy. 


This conclusion follows from the fact that any linear 



unbiased evaluation is equivalent to the solution of prob- 
lem (l) according to the method of least squares, using the 
expression- - 

- anj tmn [ d- <A(cp] p [3 - d (<p] , ( 58) t 


where P is the weighted-' matrix, selected hy the appropriate 
method [ 26 ]. The difference between the classical algorithm 
(4) and expression (58) consists of the fact that, in the 
former case, the weighted matrix is determined by the equality’ 
P=L 1 , which follows directly from the well-known Gauss- 
Markov theorem [l], and in the latter case, the weighted 
matrix can be found from the solution of the corresponding 
problem of linear programming. 

Thus, for the solution of applied problems, one can 
successfully make use of the well-developed algorithms of 
the method of least squares (with the condition of preliminary 
processing of anomalous measurements) . However, planning of 
the experiment and evaluation of the accuracy of the ob- 
tained results should be carried out with regard for the 
potential spreads of the distributions of the probabilities 
of the errors £ . 

6. Evaluation with Restrictions on the Elements of the Mathe- 
matical Expectancy and the Covariational Matrix of Errors 

Based on the methods described in the preceding section, 
one can obtain sufficiently reliable guaranteed evaluations 

A 

of the accuracy of determination of the vector q, according 
to the results of measurements, as well as solving the prob- 
lem of the selection of an optimal linear unbiased algorithm 
of filtration and an optimal plan of measurements, which en- 
sure a maximum guaranteed accuracy of q". Therefore, these 
methods are presently beginning to be widely utilised during 
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the solution of vital problems, which place high requirements 
on the accuracy and reliability of the evaluation (for example — 
for determining the initial data for controlling the flight of 
a spacecraft) . A shortcoming of these methods is the fact 
that they often give excessively less sensitive evaluations 
of the accuracy of - q. In this connection, methods have begun 
to be developed, in recent years for solving the examined 
problems, assuming that the coefficients K (?.£, C of corre- 
lation between the components of the vector £ are not random, /34 
but lie within some boundaries. 

In the simplest variant of the indicated posing of the 
problem, the problem of construction of the optimal linear 
unbiased algorithm of evaluation, anddselectioncofoitihe optimal 
plan of the measurements was solved in C2lH. The results of 
this study are set forth in detail in [l3* Here, it is 
assumed that the set F of possible distributions of F(£) is 
determined by the inequalities in (41) and the condition 

Ijd&.WK* , '■*} V < S9 > 

where 0 £1 is a given number, and expression (42) is uti- 

lized as the guaranteed characteristics of accuracy. 

Through these assumptions, it was proved that the optimal 
situation Is the utilization of the method of least squares, 
with the condition of concentration of all. of the points 
measured in m (m is the dimensionality of the vector q) , 
determined by the solution of some problem of linear pro- 
gramming. With an increase in the total number n of measure- 
ments, the accuracy of evaluation increases; however, with 
k>0 

tim mc«3)(S£)>0, 

h-yc® 7 7 


33 



i.e. , the evaluation of q is not consistent. In this case, 
beginning with some value of n, a subsequent increase in the 
number of measurements leads to such an insignificant increase 
in accuracy that it can be considered practically useless. 

The indicatedfctrend;fire©eived further development in study 
[22j, in which condition (59) is replaced by a restriction of 
the type 

K t 4 K ) 4 *< x y 


where ki and k 2 are given numbers. 

The cjjr o bl emeof bguanant e e,dne valupi oniq/as:: ex'aminedbin a 
co ns aider ably more general posing in studies [23 , 2^ , 2$J, in /3 5 

which the following restrictions, which determine the set 
of possible distributions, are placed on the elements of the 
mathematical expectancy E={E( C^) > « * • >E (t. j) 3=and the covari- 
ation matrix D( z) =( bij) of the errors. 

k |E(UI 6Mi , (60) 

j Siq + u-ij, (6i) 

where M£, D % . , and v • • $ 0 ( £, j-1 , ■ ■ - ,n) are given numbers. 

In place of condition (61) , one can examine the following 
restrictions, placed on the dispersion #( Zi) and the coeffici- 
ents of correlation K( £., ?. ) 

^ J 


a> (to* 5 7 Ky-un, « k ($. ,<62) 


where 6 £ f K^« , and y $0 (€ , i, , . . • , n) are given numbers 
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The following magnitudes are utilized as guaranteed 
characteristics of accuracy 

jECSQl, €D gu = max gf> (5 e) . (65) 

er !r 

Two variants of the criteria of optimalness are examined, 
utilized during the selection of a strategy S of the solution 
of the examined problem in the set 2 of possible strategies. 

In the first variant, we are searching for 

^u~ mQX E(S l e) = hag U +a>g U . ( 64 ) 

In the second variant, the following is found /36 

max H _ H.,r min PCiStlss) . (65) 

s guar gii y 

Here, P gua3 is the guaranteed value of the mathematical 
expectancy of the square of the error 6&, Hg uar is the guaran- 
teed reliability of the. realization of the inequality 

A 

is the permissible maximum error of evaluation of & , and 
P{ *) is the probability of realization of some event. 

The first of these variants does not require any sort 
of assumptions on the distribution of the errors 6£. In 
order to utilize the second variant, it is necessary to have 
this distribution as a given. If it is normal, then one can 
write that, with m guar ^^£l] 



where 




je Mt . 


© 


It is easy to assert that the posings of the problem used 
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in paragraphs 2 and 5 of the present study are particular 
cases of the general posing given here* Actually, assuming 
that, in expressions ( 60 ) and (61), 

Mi =0/^=0, (i } j=1,... } h) 

and taking into account the fact that, here, ^g mr "6 and 
P 3= Dgu &1 rD( &£,) , we obtain the' classical posing of the problem, 
which underlies the method of least squares. 

On the other hand, assuming that 

a>q = 0 , \hj ; =Q U,ic4,...,h) 

and making use of the magnitude ir^ uar =max| Sg, j as the character- 
istics of accuracy, we obtain a posing of the problem which 
leads to evaluation according to an "upturn" . /37 

Thus, the posing of the problem given here makes it 
possible to construct a broad spectrum of solutions of the 
problems of evaluation, which include the method of least 
squares and evaluation according to an "upturn" as specific 
cases. The selection of one variant or another within this 
spectrum depends on the existing information on the mathe- 
matical expectancy and the covariation matrix of the errors £ , 
as well as the required reliability of the solution of the 
problem of evaluation. 

With the aforementioned assumptions (6o) and (61) or (6o) 
and ( 6 2 ), the following basic results were obtained in studies 
[23,24,25]- 

A. For a random linear (or linearized) unbiased algo- 
rithm of evaluation, the error 6 f of which can be represented 
in the form [1] 

‘ 5£-xf , (6?) 
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where X=(X lf . . . ,Xn) is some matrix with a 1 xn dimension, 
expressions are written down for the guaranteed character- 
istics of accuracy m g uar an< i Pg Uat ) which are the upper "bound- 
aries of the magnitudes of |E(S£,)I and P(U) in the set F. 4 

The first of these characteristics is strict in termsao.f r( 33) i 
and satisfies the first of the equations in ( 63 ) . As far 
as the second characteristic is concerned, we determine the 
conditions of strictness which are necessary and sufficient, 
and show that, in this case, it satisfies the second of the 
equalities in ( 63 ) • 

B. For the case when the mathematical model (1) is 
linear relative to q, we examine the problem of construction 
of a linear unbiased algorithm of filtration and selection 
of a plan of measurements which are optimal according to 
one of the criteria of (64) or ( 65 ) ■ It is shown that it 
comes down to the problem of quadratic (in specific cases — 
linear) programming, for which there is a numerical algo- 
rithm of solution. Some properties of this solution are 
examined. Specif icallyy it is shown that, in the general 
case, the obtained evaluation is inconsistent. The conditions 
are determined under which the optimal plan of measurements 
is reduced to the accumulation of measurements at some finite 
number of points. 

The obtained results are naturally extended to the case 
when the mathematical model (1) is constructed based on the 
solution of the vector differential equation (43) • 

As an example, we will examine the determination of 
the velocity v, based on model (17) » assuming that the errors 
with restricted values of the dispersions and the coeffici- 
ents of correlation are added to errors which satisfy the 
conditions in (44) . Here, the set F of possible distri- 



buttons of the errors £ is determined by the following con- 
ditions, imposed on the mathematical expectancies E (£•£), the 
dispersions , and the coefficients of correlation 

K of the components £-£ of the vector £ , 

|E<yk&* cwjsij. w*>,<«> ! 

where A ^0, w >*0 , 6 s >.0, and 1> K> 0 are given numbers. 


Given in study [243 is the solution of the problem of 
selecting a linear unbiased algorithm for constructing the 
evaluation of v with theuas sumptions in (68) , and also 
assuming that the number n of utilized measurements is given 
(or restricted at the top) . In this case, optimization is 
carried out according to criterion (64) . As a result, it is 
shown that the optimal plan enviasges the conduct of all 
measurements at two moments in time t a and t 2 . Here, 


T„ = z 

n,- } x, =-Xi = 



(69) 


Z29 


where is the total duration of the interval of measurements, 
n^ are the number of measurements at the moments ti,_x£ are 
the sums of the coefficients of algorithm (45) of evalu- 
ation (£=1,2), which correspond to these moments, and 

T'&'J ^tK . (70) 


Here 


mih. 

'L 


?guaT~ W CfHa 1 + *) 


cm 


We will compare the obtained result with the evaluation 
according to the method of least squares, with uniform distri- 
bution of the times of the measurements in the closed interval 
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C?2) 



where T is the given duration of the interval (72). 


Given in [24] is the asymptotic expression, corresponding 
to this case, for 3^ a>rS which is correct with a sufficiently 
large n 



(W) 


The minimum of this expression is achieved with the con- 

i 

dition (57)* Here, 3g Uai f H l *06 min Pgua^, where the magnitude of 

min 3 is determined hy expression (71) • 
e g UdI 


Thus, the switch from the optimal algorithm of fil- /4o 

tration to the method of least squares, with uniform distri- 
bution of the times of the measurements, impairs the magni- 
tude of 3 only slightly. However, this result is achieved 

3-X 

only with the correct selection of the duration of the T- 
dimensional interval. It is evident from (73) that the 
deviation from condition (57) in one direction or the other 
may lead to a sharp impairment of the guaranteed accuracy of 
evaluation of v- 


Given in [253 is the solution of this very same problem 
with replacement of condition (64) of optimalness by con- 
dition (65). Here, the law of distribution of errors 6& 
is assumed to be normal. The optimal plan, obtained as a 
result, also provides for the conduct of all measurements 
at two moments in timettx and t 2 . Here, 


, h,.h l =a ) 5( t = .y t -.a- > 


where T x is the optimal duration of the interval of measure- 
ments, for the determination of which a numerical algorithm 
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is given. Also compared are the values of the maximum 

errors } a t which an identical guaranteed reliability H| 3ar 

determined by expression ( 65 ), is provided. It is shown that, 

in the examined problem, with H •$.<) .999 > the switch from the 

gua. j? 

criterion in ( 65 ) to the criterion in (64) entails an increase 
in the maximum error ^ of no more than 17 % . 

Thus, with the assumption of the normalcy of distribution 
of the evaluation of 6&, optimization according to the cri- 
terion in ( 65 ) mates it possible to somewhat improve the 
preciseness of the value of the maximum error with a 
given guaranteed reliability (by comparison with the utili- 
zation of the criterion in ( 64) ) . 


With random distribution of the errors 6 l, the magni- 
tude of P , determined by expression (64) , sufficiently /4l 

guar . A 

completely characterizes the accuracy of evaluation of l . 
Specifically, in this case, it is associated with the 
guaranteed reliability Hi ^ and the maximum error by the 
following relationship, which follows directly from Tchebycheff ' s 
inequality \_2~\ 

Therefore, in the examined example, expression (71) 
characterizes the maximum accuracy of evaluation of v , with 
a given number n of measurements. Hence, making use of ( 70 ) 
and assuming that n-* 50 , we lind the magnitude 

Ysuvf. mm - \/w- ( +A*- 1 + A) _ } (7?) 
n . ^ guar 


which determines the precise lower boundary of P gua] i n the 
set of all linear unbiased algorithms of evaluation with a 
random number n of measurements. This magnitude determines 
the best information content of the evaluation of v, inherent 


40 



in- the given problem. -This' magnitude depends on the parameters 
“w, k, b, and A, which are part of condition (68) and deter- 
mine the set F * of possible distributions of the errors £ . 

* <. 

It is evident that- the equality 



is aene a e as prsmandugilf f iementc c onditai oriceff the possibility of 
constructing a consistent linear unbiased algorithm of evalu- 
ation. This equality may occur with one of the following 
conditions: 


A. (w = 0, k<j$£.'0 , a£ 0-. From dependences ( 69 ) and ( ?0) , it 
Is evident that, in this case, consistency is achieved be- 
cause of the unrestricted increase in the duration T of the 
interval of "measurements . 

B. w j*0, kb=0_, A=0 . Consistency is achieved because of 
the fact that T o -»0. 

C. w=0, kb=0 , A=0. Consistency is achieved with a random 
T 0 only because of the fact that n-*». We will note that a 
specific case of this condition is the simultaneous ' ful- 
fillment of equalities w=k=A=p. If, in this case, one re- 
places inequality £( Ci)< b 2 with equality V ) =b 2 , then 

the dependences in (68) are transformed into assumptions 
which lead to an algorithm of evaluation .according to the 
method of least squares. 

Thus,, in the examined problem, a consistent evaluation 
can only be obtained in s'ome idealized particular cases, which 
almost never take place In practice . 


With kb=0 , the righthand portion of equality ( 75 ) coin- 



cides with the corresponding expression (50) , obtained on 
the basis of restriction according to an ’’upturn: . 


We will examine also the case A=0 . Here, expression 
(75) takes on the form 

yL - > 


Thus, with A=0 and assuming the random correlation be- 

1/2 1/2 

tween the components of the vector of the errors, . 

With restriction of the moduli of the coef f icientssof corre- 


lation of the magnitude , the value of x diminishes m pro- 
y 4 

portion to k 


It is evident from the examined example that the guaran- 
teed accuracy of evaluation depends substantially on the re- 
strictions which determine the set F of possible distri- 
butions of F(^). Here, the placement of more rigid restric- 
tions makes it possible to improve the guaranteed evaluation 743 
of accuracy. 


7* Statistical Simulation of Problems of Evaluation - 

The above-described methods for solving problems of 
evaluation have strict mathematical bases, which are based on 
some assumptions about the ideal mathematical model d=d(q.) , 
the set f of possible errors C, and the set 2 of permissible 
strategies of the solution of the problem. In the general 
case, when these assumptions are not fulfilled, one can use 
the method of statistical simulation, which consists of the 
following. 

We will examine problem (1) with some given d=d(q) , F , 
and 2. We will be given the algorithm of q=p(d) and the compo- 
sition d of the measurements which belong to the set of per- 
missible strategies. They can be obtained from the solution 
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of the strict problem, with some idealized assumptions, or 

found on the basis of heuristic considerations. In addition, 

we will be given the nominal value q Q of the vector q. Mating 

use of the generator of random numbers , and taking into 

account the condition F(t;)eF» we will construct a random set 

% 

of vectors ( j=l , . . . ,ii/) of the errors, and the corresponding 

model set of measured vectors . d^-=d( q) +Sb- (j=l Then, 

we will compute the model evaluations of q^ =q ( d ^ ) and find 
their errors 6q_.=q_*-q^ Q=1 , . . . ,n) . The statistical charac- 
teristics of the set of these errors are utilized for the 
evaluation of the quality of the examined solution of the 
problem of evaluation. By carrying out similar computations 
for different compositions of measurements and algorithms of 
evaluation, one can select the optimal ones among them. Here, 
optimization can be carried out not only according to the 

A 

criterion of achieving maximum accuracy of evaluation of q, 
but also from other considerations (simplicity of the utilized 
algorithms, their rapid action, etc.) . 

An advantage of this method is the possibility of its 
utilization for the most varied assumptions and criteria of 
optimalness. A shortcoming is the Impossibility of obtaining 
mathematically strict solutions. Here, only the more or less 
'•plausible" results can be found* (In the sense that it is 
understood in [27])- In spite of this,- the method of statis- 
tical simulation is utilized successfully for the solution of 
applied problems of evaluation [28, 29 >30 D* 

, 8. Conclusion 

It follows from the results given above that notable 
successes have been achieved in recent years in the develop- 
ment of methods of evaluation, based on the assumption that 
the distributions of the errors in the initial data are not 
precisely known, and belong to some given sets. Here, the 



"basic progress has taken place in the following two areas. 

A. It is assumed that the vector of measurements d is 

a set of a finite number of vectors d>, which are identically 

if 

associated with the vector q of state. The errors which 
correspond to these vectors are assumed to be identically 
distributed and mutually independent. Also given is a set 
^'•■df possible distributions F'(Cj’) of these errors, and we 
seek an algorithm of evaluation, which possesses asymptotic 
.effectiveness with the "worst" distribution F'(sj) in the set 
F x . In this case, "worst" is understood to mean such a distri- 
bution F'CSjOeF' with which a minimum of Fisher information 
is achieved. It is shown that algorithms constructed in this 
way possess good stability with respect to interference , 
caused by anomalous errors? i . Methods are developed for 
constructing similar antisinterference algorithms with 
different methods of representing the set F' . The number of 
such algorithms includes theimethodipf least moduli, which has 
been developed in sufficient detail. 

A shortcoming of a similar approach is the fact that 
possible dependences between different vectors of Cj are 
not taken into account in it, and neither are possible differ- 
ences between the distribution of these vectors and the devi- 
ation of their mathematical expectancies from the adopted a 
priori values. This leads to consistency of the obtained 
evaluations. From the theoretical point of view, the con- 
sistency of the evaluation can be shown to be attractive , but 
in practice, with the utilization of a sufficiently large 
number of measurements, it leads to instability of the evalu- 
ations of the accuracy of the obtained results. This, in 
turn, may be a cause of obtaining unjustified and optimistic 
evaluations of accuracy, as well as coarse errors during the 
solution of problems of experiment planning. 


B. The set F of possible distributions F(?) is deter 



mined by some restrictions, placed on the values of the ele- 
ments of the vector of the mathematical expectancy E( ?) and 
the covariation matrix-D(C) of the errors 

A particular case of such an assumption is the restriction 
of the area to which the errors z, may belong in the corres- 
ponding vector space. With these assumptions, one can 'deter- 

A 

mine the guaranteed accuracy of the evaluation of'q, obtained 
using any linear (or linearized) unbiased algorithm of fil- 
tration. Also solved is the problem of selecting an optimal 
linear unbiased algorithm of filtration and constructing 
the corresponding optimal plan of the experiment. Here, 
utilized in the capacity of a criterion of optimalness, is 
either the achievement of a' minimum of the guaranteed mathe- 
matical expectancy of ‘ the square of the error &£ in the * 

A 

evaluation of l of some scalar parameter Jl=jl(q) , or a maximum 
of the guaranteed reliability of the fact that 6 % < where 
*£ is the given maximally-permissible error in the evaluation 
of 1 . This problem comes down to the well-developed algorithm 
of quadratic (linear) programming. Its solution is equiva- 
lent to the search for an optimal weighted matrix during -'-fR * 
evaluation according to the method of least squares. Such 
a method is successfully used to obtain reliable guaranteed 

A 

evaluations of the accuracy* of the magnitude of q with given 
possible spread's of the mathematical expectancy and the co- 
variation matrix of the errors in the initial data, as well as 
to construct the corresponding optimal algorithms of evalu- 
ation and plans of the measurements . 

As shortcoming of such an approach is' the fact that the 
problem is solved in a set of all possible linear 'unbiased 
algorithms of evaluation. This is equivalent to the assump- 
tion of normalcy of the distribution of the errors As was 
indicated above, this is the cause of the strict dependence 
of the accuracy of the obtained evaluations of interference 



evoked by anomalous measurements. In addition, it should "be 
kept in mind that the solution of the above-indicated prob- 
lems of optimization depends on the selection of the para- 
meter A=Jl(q) , the accuracy of which we are interested in. 
Therefore, if the necessity occurs of optimizing the accu- 
racy of the evaluations of several parameters Lj =1 j (q) 
(j=l,...,k), then, in the general case, it is necessary 
to construct several algorithms qj=%(d), each of which 
optimizes the guaranteed accuracy of the corresponding evalu- 
ation. We will' note that, in a number of specific cases, 
it is possible to successfully find the universal optimal 
strategy of solution of the problem, which only slightly 

A 

impairs the accuracy of the evaluations of (j=l,...,k), 
as compared with their best achieveable accuracy. 

Unfortunately, not a single study is known to us which 
would unite both of the above-indicated approaches and solve 
the problem of optimal guaranteed evaluation, with simul- 
taneous regard for the possible spreads of the types of 
distribution of F( 0 , the possible dependences between the 
distributions of the probabilities of different components 
of the vector £, and the spreads of their mathematical 
expectancies. The solution of the examined problem, with 
such general assumptions , is obviously a matter of the future. 
While such a general solution has not been achieved, one can 
recommend the following sequence of anti- interference guaran- 
teed evaluation. 

A . Found in the first stage is the preliminary evalu- 
ation of q.p r , for which the algorithm q=q(d) is utilized, 
which possesses sufficient Interference -resistance . As a 
function of the nature of the possible interference, this may 
be either the usual method of least squres, or one of the non- 
linear anti-interference algorithms of evaluation (for example, 
the method of the minimum of the moduli) . Processing of the 



available anomalous measurements is carried out based on the 
obtained result. 

B. The 'mathematical model (1) of the problem is linear- 

A 

ized relative to the found approximate value of q 0 =q_ )r , and c 
one or several optimal linear unbiased algorithms q.j=qj(d) 
are constructed, which provide the best guaranteed accuracy 
of the evaluations of theggiven parameters &j=£j(q) (j=l,...,k). 

A similar method for solving the problem of evaluation 
is considerably more timeOc.onsuming than the normal method 
of least squares. In addition, it requires detailed pre- 
liminary analysis of the possible errors ? for the correct 
selection of the set j? of possible distributions of these 
errors. However, for the solution of sufficiently vital 
problems and the utilization of modern computer technology, 
it may be considered fully justified. 



REFERENCES 


1. El'yasberg, P. Ye., Opredelenie dvizheniya po rezul'tatam 
izmereniy CD e termination of Movement According to the Re- 
sults of Measurements], Moscow, "Nauka" , 1976. 

2. Rao, S. R., Lineynye statisticheskie metody i ikh primen- 
enie [Linear Statistical Methods and Their Application J, 
Moscow, "Nauka", 1968. 

3* Le-Cam, 1., "On Some Asymptotic Properties of Maximum 

Likelihood Estimates and Relates Bayes' Estimates", Univ . 
Calif. Public . Statist. 1 (11). 277-330 (1953). 


4. Gurin, L. S., ”0 sostoyatel 'nosti otsenok metadavmammen' - 
shikh kvadratov" [The Consistency of Evaluations of the 
Method of Least Squares], in the collection: Matematich- 
eskoe obespechenie kosmicheskikh eksperimentov I Mathematical 
Provision of Space Experiments]", Moscow, "Nauka" , 1978. 

5- Mudrov, V. I., Kushko, V. L. , Metody obrabotki izmereniy 
[Methods for Processing Measurements J, Moscow, "Sovetskoe 
Radio", 1976. 

6. El'yasherg, P. Ye., "Garantirovannaya otsenka tochnosti 

opredeleniya dvizheniya kosmicheskikh apparatov" [Guaran- 
teed Evaluation of the Accuracy of Determination of the 
Movement of Spacecraft], Kosmicheskie issledovaniya 12(1) , 
(1974). ~ ~ ' 

7 . Tukey, J. W. , "A Survey of Sampling from Contaminated 
Distributions" , In: Contributions to Probability and 
Statistics , Ed. by I. Olkin, Acad. Press, - i960. 

8. Tukey, J. W. , "The Future of Data Analysis", Ann. Math. 

Stat. 33(1), 331 (1962). 

9- Huber, P. J. , "Robust Estimation of a Location Parameter", 
Ann. Math. Stat. 35(1), 73 (1964). 

10. Polyak, B. T., Tsypkin, Ya. Z., "Pomekhoustoyehivaya 
identifikatsiya" [Anti-Interference Identification], in 
the Collection: Identifikatsiya i otsenka parametrov sis- 
tem [identification and Evaluation of the Parameters of a 
System], I, 190, Preprints IV of the Symposium of IFAK, 
Tbilisi, "Mitsniereba" , ’.1976 . 

11. Tsynkin, Ya. Z. , Polyak, B. T., "Ogrublennyy metod maksi- 
mal'nogo pravdopodobiya" [Rough Method of Maximum Proba- 
bility], Inter-Institution Collection: Dinamika sis tern 
[System Dynamics], 12, Moscow, 197 7- 


48 



12. 


Gil'bo, Ye. P. , Chelpanov, I. B., O'brabotka signal ov na 
osnove uporyadochennogo vybora . [Processing of Signals, 

Based on Ordered Selection], Moscow, "Sovetskoe radio", 

1975. 

13* Lidov, M. L. , "K apriornym otsehkam tochnosti opredel- 
eniya parametrov po metodu naimen' shikh kvadratov" [A 
Priori Evaluations of the Accuracy of Determination of 
Parameters, According to the Method of Least Suqres], 
Kosmicheskie issledovaniya 2(5) (1964) . 

14. Belousov, L. Yu., Krupen', V. Ya. , "0 nekotorykh asimp- 
toticheskikh otsenkakh nachal'nykh parametrov pri iz- 
merenii dal'nosti" [Some Asymptotic Evaluations of the 
Initial Parameters , with Measurement of Range], Kosmicheskie 
issledovaniya 8 ( 5 ) (1970) • 

15* Elfing, G., "Optimum Allocation in Linear Regression 
Theory", Ann. Math. Statist. , 23, 255 (1952). 

16. Bazhinov, I. K. , Pochukaev, V. N. , Optimal 'noe planiro- 
vanie navigatsionnykh izmereniy v kosmicheskom polete 
[Optimal Planning of Navigational Measurements in Space 
Flight], Moscow, "Mashinostroenie" , 1976. 

17* Novak, B. L. , "0 vliyanii momentov sil na tochnost' 

opredelehiya orientatsii iskusstvennykh sputnikov" [The 
Effect of Moments of Force on the Accuracy of Determin- 
ation of the Orientation of Artificial Satellites], 
Kosmicheskie issledovaniya .10(2) ( 1972 ) . 

18. Hutchinson, C. E., D’Appolito, J. A., Bongiovani, P. L. , 
"Minimax Design of Kalman-like Filters in the Presence of 
Large Parameter Uncertainties", AIAA Paper, 1972, No. 878 . 

19. Nishimura, I., "Worst-Error Analysis of Batch Filter and 
Sequential Filter in Navigation Problems", Journal of 
Spacecraft and Rockets 1.2(3) » 133 (1975) • 

20. Kurzhanskiy, A. B., Upravlenie i nablyudenie v usloviyakh 
neopredelennosti [Control and Observation Under Conditions 
of Ambiguity], Moscow, "Nauka" , 1977 • 

21. Bashinov, I. K. , Pochukaev, V. N. , "Geometricheskaya 
interpretatsiya zadach otsenki tochnosti opredeleniya 
traektoriy kosmicheskikh apparatov" [Geometric Inter- 
pretation of Problems of Evaluation of the Accuracy of 
Determination of the Trajectory of Spacecraft], Kosmiches- 
koe issledovaniya 9(2) (1971). 

22. Bakhshiyan, B. Ts., "Nekotorye zadachi otsenki tochnosti 
prognozirovaniya parametrov traektorii i algoritmy ikh 


49 



resheniya" [Some Problems of Evaluation of the Accuracy 
of Forecasting of the Parameters of the Trajectory and 
the Algorithms for their Solution!!, Kosmicheskie issledo- 
vaniya 1_2(2) (1974) • 

23* Bakhshiyan, B. Ts., Nazirov, R. R. , El'yasberg, P. Ye., 

"0 garantirovannykh kharakteristikakh tochnosti opredel- 
eniya parametrov dvizheniya kosmicheskikh apparatov" 
[Guaranteed Characteristics of Accuracy of the Determin- 
ation of Parameters of Movement of Spacecraft!], Kosmich- 
eskie -issledovaniya 15 (4) , 546 (1977)* 

24. Bakhshiyan, B-. Ts., Razirov, R. R. f El’yasberg, P. Ye., 
Optimizatsiya opredeleniya orbity p'ri nepolnom znanii 
kovariatsionnoi matritsy i matematicheskogo ozhidaniya 
oshibok I Optimization of the Determination of the Orbit 
with Incomplete Knowledge of the Covariation Matrix and 
Mathematical Expectancy of the Errors], Vol. 15, Mo. 5> 

658 (1977). 

25- Bakhshiyan, B.-Ts., Nazirov, R. R. , El'yasberg, P. Ye., 
Optimizatsiya gar ant irov annoy nadezhnosti opredeleniya 
parametrov orbity v uslobiyak neopredelennosti [Optimi- 
zation of the Guaranteed Reliability of the Determin- 
ation of Parameters of an Orbit Under Conditions of 
Ambiguity!), Vol. 15 , No. 6 , 835 ( 1977 ) . 

26. Rao, C. R., Unified Theory of Linear Estimation , Sankhya, 
'Series A, No. 33, 371 ( 1971 ) . 

27. Poya, D. , Matematika i pravdopodobnye rassuzhdeniya 
[Mathematics and Probability Discussions J , Moscow, 

"Nauka", 1975- 

28. Gurin, L. S. , Tsoy, -K. A., "Primenenie statisticheskogo 
modelirovaniya pri razrabotke i sravnitel ’nom analize 
metodov otsehki parametrov" [Use of Statistical Simu- 
lation During the Development and Comparative Analysis 

of Methods of Parameter Evaluation!!, Collection: Qbrabotka 
kosmicheskoy informats ii [Processing of Space Information J, 
Moscow, ""Nauka", 1976 • 

29. Burgin, M. S. , Gurin, L. S., Tsoy, K. A., "Otsenki para- 
metrov modif itsirovarmogo' raspredeleniya Puassona" [Evalu- 
ations of the Parameters of a Modified Puasson Distri- 
bution!), Collection: Matematicheskoe obespechenie kos- 
micheskikh eksperimentbv [Mathematical Provision of Space 
Experiments J , Moscow, "Nauka" , 1978. 

30. Gurin, L. S., Tsoy, K. A., Ustoychivye (robastnye) 
uslovno effektivnye otsenki~parametrov [Stable, Condition- 
ally Effective Evaluations of Parameters], IKI AN SSSR 
Preprint, 382 , 1977- 


50 




Figure 1 

Dependence of -the Guaranteed Value of Pguarof the Square 
of the Error of the Arithmetic Mean on the Number n of 

Measurements 




